Inference Fusion with Associative Semantics for Unseen Object Detection
نویسندگان
چکیده
We study the problem of object detection when training and test objects are disjoint, i.e. no examples target classes available. Existing unseen approaches usually combine generic frameworks with a single-path classifier, by aligning regions semantic class embeddings. In this paper, inspired from human cognitive experience, we propose simple but effective dual-path model that further explores associative semantics to supplement basic visual-semantic knowledge transfer. use novel target-centric multiple-association strategy establish concept associations, ensure predictor generalized domain can be learned during training. way, through reasonable inference fusion mechanism, those two parallel reasoning paths strengthen correlation between seen objects, thus improving performance. Experiments show our inductive method significantly boost performance 7.42% over models, even 5.25% transductive models on MSCOCO dataset.
منابع مشابه
Single-Shot Object Detection with Enriched Semantics
We propose a novel single shot object detection network named Detection with Enriched Semantics (DES). Our motivation is to enrich the semantics of object detection features within a typical deep detector, by a semantic segmentation branch and a global activation module. The segmentation branch is supervised by weak segmentation ground-truth, i.e., no extra annotation is required. In conjunctio...
متن کاملSemantic middleware: multi-layer abstract semantics inference for object categorization
In this paper, we present a hierarchical model, named as Multi-layer Abstract Semantics Inference (MASI), based on Bag-of-Visual-Words (BoVW) to solve the problem of universal image categorization, including typical and zero-shot image categorization. An abstract hierarchical semantics learning method is proposed in the training step by extracting and selecting abstract visual words in a bottom...
متن کاملLearning Search Based Inference for Object Detection
We study the problem of visual object detection and propose a method that learns the inference procedure during training time. We propose a best-first search based inference system that is already optimized for during training. This overcomes the inherent limitation of branch&bound whose applicability relies on the availability of tight bounding functions. The optimization problem is implemente...
متن کاملGraph-based Inference with Constraints for Object Detection and Segmentation
For many fundamental problems of computer vision, adopting a graph-based framwork can be straight-forward and very effective. In this thesis, I propose several graph-based inference methods tailored for different computer vision applications. It starts from studying contour-based object detection methods. Compared to other image cues, the outline contour (silhouette) is invariant to lighting co...
متن کاملCooperative Coevolution Fusion for Moving Object Detection
In this paper we introduce a novel sensor fusion algorithm based on the cooperative coevolutionary paradigm. We develop a multisensor robust moving object detection system that can operate under a variety of illumination and environmental conditions. Our experiments indicate that this evolutionary paradigm is well suited as a sensor fusion model and can be extended to different sensing modalities.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2021
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v35i3.16295